Size variant pressure eraser

ABSTRACT

A method of adjusting the size of an area to be deleted in a pen-based computing system is provided. An electronic pen may include an eraser end. The eraser end may be used to contact the display surface of a computer system. Application of pressure to the display through the eraser end of the electronic pen may result in the deletion of the text indicated by the position of the electronic pen. As additional pressure is applied, the size of the area to be deleted increases. The invention provided may be used with both pixel type and stroke type erasing systems and provides an efficient and accurate method of deleting electronic ink.

BACKGROUND

Typical computer systems, especially computer systems using graphicaluser interfaces (GUIs), are optimized for accepting user input from oneor more discrete input devices, such as a keyboard for entering text,and a pointing device, such as a mouse with one or more buttons, foroperating the user interface. An example of such a GUI is the userinterface for the WINDOWS® computer operating system (available fromMicrosoft Corporation of Redmond, Wash.). The ubiquitous keyboard andmouse interface provides for fast creation and modification ofdocuments, spreadsheets, database fields, drawings, photos, webpages,and the like.

Recently, however, pen-based computing systems, such as tablet PCs,personal digital assistants, and the like, have been increasing inpopularity. In pen-based computing systems, user input advantageouslymay be introduced using an electronic “pen” or stylus (e.g., akin towriting with a pen or pencil on a piece of paper). Indeed, in at leastsome pen-based computing systems, all user input is capable of beingentered and manipulated using an electronic pen input device, and theuser interface is fully controllable using only the electronic pen.

As pen based computing systems become more popular, users areincreasingly entering more data in the form of electronic ink. As withany computer input device, errors are possible and corrections must bemade. The ability to erase electronic ink from the user interface isnecessary and the ability to use the electronic pen to erase this inkcan be highly efficient.

SUMMARY

The present invention relates to systems and methods of erasingelectronic ink from a computer system display. In one example, anelectronic pen or stylus includes an eraser end and a writing end. Theeraser end may be used to contact the display surface. As pressure isapplied to the surface, the electronic ink indicated by the position ofthe pen may be erased. As the applied pressure increases, a larger areaof electronic ink may be deleted (e.g., a wider erasure path may beprovided).

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is illustrated by way of example and not limitedin the accompanying figures in which like reference numerals indicatesimilar elements and in which:

FIG. 1 illustrates a schematic diagram of a general-purpose digitalcomputing environment in which certain aspects of the present inventionmay be implemented;

FIG. 2 illustrates a pen based personal computing environment in whichcertain aspects of the present invention may be implemented;

FIGS. 3A-3C illustrate one example of systems, methods and userinterfaces according to the present invention in which electronic ink isdeleted with a pixel type eraser; and

FIGS. 4A-4E illustrate another example of systems, methods and userinterfaces according to the present invention in which electronic ink isdeleted with a stroke type eraser.

DETAILED DESCRIPTION

The present invention relates to user interfaces, systems, methods andcomputer-readable media for processing electronic data and interactingwith electronic text in pen-based computing systems. In general, aspectsof the invention relate to user interfaces, displayable by anappropriate display device and activated by an electronic pen, that maybe used for deleting or erasing electronic text or ink and/or otherwiseinteracting with electronic text or ink using pen input in pen-basedcomputing systems. Such interfaces may include: (a) a display portionthat displays an original text (e.g., electronic ink, machine-generatedtext provided by a handwriting recognition engine or some other source,etc.); (b) an electronic pen having an eraser end; and (c) a correctionor erasure mechanism that the user may activate by contacting the eraserend of the electronic pen to the display portion displaying theelectronic ink or text. Aspects of this invention also relate tosystems, methods and computer-readable media for operating and/orinteracting with user interfaces of the types described above.

FIG. 1 illustrates a schematic diagram of a general-purpose digitalcomputing environment that can be used to implement various aspects ofthe present invention. In FIG. 1, a computer 100 includes a processingunit 110, a system memory 120, and a system bus 130 that couples varioussystem components including the system memory 120 to the processing unit110. The system bus 130 may be any of several types of bus structuresincluding a memory bus or memory controller, a peripheral bus, and alocal bus using any of a variety of bus architectures. The system memory120 may include read only memory (ROM) 140 and random access memory(RAM) 150.

A basic input/output system 160 (BIOS), which contains the basicroutines that help to transfer information between elements within thecomputer 100, such as during start-up, is stored in the ROM 140. Thecomputer 100 also may include a hard disk drive 170 for reading from andwriting to a hard disk (not shown), a magnetic disk drive 180 forreading from or writing to a removable magnetic disk 190, and an opticaldisk drive 191 for reading from or writing to a removable optical disk199, such as a CD ROM or other optical media. The hard disk drive 170,magnetic disk drive 180, and optical disk drive 191 are connected to thesystem bus 130 by a hard disk drive interface 192, a magnetic disk driveinterface 193, and an optical disk drive interface 194, respectively.These drives and their associated computer-readable media providenonvolatile storage of computer-readable instructions, data structures,program modules, and other data for the personal computer 100. It willbe appreciated by those skilled in the art that other types ofcomputer-readable media that can store data that is accessible by acomputer, such as magnetic cassettes, flash memory cards, digital videodisks, Bernoulli cartridges, random access memories (RAMs), read onlymemories (ROMs), and the like, may also be used in the example operatingenvironment.

A number of program modules can be stored on the hard disk drive 170,magnetic disk 190, optical disk 199, ROM 140, or RAM 150, including anoperating system 195, one or more application programs 196, otherprogram modules 197, and program data 198. A user can enter commands andinformation into the computer 100 through input devices, such as akeyboard 101 and pointing device 102 (such as a mouse). Other inputdevices (not shown) may include a microphone, joystick, game pad,satellite dish, scanner, or the like. These and other input devicesoften are connected to the processing unit 110 through a serial portinterface 106 that is coupled to the system bus 130, but they also maybe connected by other interfaces, such as a parallel port, game port, ora universal serial bus (USB), and the like. Further still, these devicesmay be coupled directly to the system bus 130 via an appropriateinterface (not shown).

A monitor 107 or other type of display device also may be connected tothe system bus 130 via an interface, such as a video adapter 108. Inaddition to the monitor 107, personal computers typically include otherperipheral output devices (not shown), such as speakers and printers. Insome example environments, a pen digitizer 165 and accompanying pen orstylus 166 are provided in order to digitally capture freehand input.Although a connection between the pen digitizer 165 and the serial portinterface 106 is shown in FIG. 1, in practice, the pen digitizer 165 maybe directly coupled to the processing unit 110, or it may be coupled tothe processing unit 110 in any suitable manner, such as via a parallelport or another interface and the system bus 130 as is known in the art.Furthermore, although the digitizer 165 is shown apart from the monitor107 in FIG. 1, the usable input area of the digitizer 165 may beco-extensive with the display area of the monitor 107. Further still,the digitizer 165 may be integrated in the monitor 107, or it may existas a separate device overlaying or otherwise appended to the monitor107.

The computer 100 can operate in a networked environment using logicalconnections to one or more remote computers, such as a remote computer109. The remote computer 109 can be a server, a router, a network PC, apeer device or other common network node, and it typically includes manyor all of the elements described above relative to the computer 100,although for simplicity, only a memory storage device 111 has beenillustrated in FIG. 1. The logical connections depicted in FIG. 1include a local area network (LAN) 112 and a wide area network (WAN)113. Such networking environments are commonplace in offices,enterprise-wide computer networks, intranets, and the Internet, usingboth wired and wireless connections.

When used in a LAN networking environment, the computer 100 is connectedto the local area network 112 through a network interface or adapter114. When used in a WAN networking environment, the personal computer100 typically includes a modem 115 or other means for establishing acommunications link over the wide area network 113, such as theInternet. The modem 115, which may be internal or external to thecomputer 100, may be connected to the system bus 130 via the serial portinterface 106. In a networked environment, program modules depictedrelative to the personal computer 100, or portions thereof, may bestored in the remote memory storage device.

It will be appreciated that the network connections shown are examplesand other techniques for establishing a communications link between thecomputers can be used. The existence of any of various well-knownprotocols such as TCP/IP, Ethernet, FTP, HTTP, UDP, and the like ispresumed, and the system can be operated in a user-server configurationto permit a user to retrieve web pages from a web-based server. Any ofvarious conventional web browsers can be used to display and manipulatedata on web pages.

Although the FIG. 1 environment shows one example environment, it willbe understood that other computing environments also may be used. Forexample, one or more examples of the present invention may use anenvironment having fewer than all of the various aspects shown in FIG. 1and described above, and these aspects may appear in variouscombinations and subcombinations that will be apparent to one ofordinary skill. Additional elements, devices or subsystems also may beincluded in the computer system without departing from this invention.

FIG. 2 illustrates a pen-based personal computer (PC) 201 that can beused in accordance with various aspects of the present invention. Any orall of the features, subsystems, and functions in the system of FIG. 1can be included in the computer of FIG. 2. The pen-based personalcomputer system 201 includes a large display surface 202, e.g., adigitizing flat panel display, such as a liquid crystal display (LCD)screen, on which a plurality of windows 203 is displayed. Using astylus, or electronic pen 204, a user can select, highlight, and writeon the digitizing display area and thereby enter electronic ink datainto the system. The pen-based computing system 201 interprets gesturesmade using stylus 204 in order to manipulate data, enter text aselectronic ink, and execute conventional computer application tasks,such as creating, editing, and modifying spreadsheets, word processingprograms, and the like.

The stylus 204 may be equipped with buttons, pressure sensingcapabilities or other features to augment its capabilities. In oneexample, a stylus 204 could be implemented as a “pencil” or “pen,” inwhich one end constitutes a writing portion and the other endconstitutes an “eraser” end, and which, when moved across the display,indicates portions of electronic ink on the display that are to beerased. Other types of input devices, such as a mouse, trackball,keyboard, or the like also could be used. Additionally, a user's ownfinger could be used as an input device, e.g., for selecting orindicating portions of the displayed image on a touch-sensitive orproximity-sensitive display. Consequently, the term “user input device,”as used herein, is intended to have a broad definition and encompassesmany variations on well-known input devices.

In various examples, the system provides an ink platform as a set of COM(component object model) services that an operating system and/or anapplication program can use to capture, manipulate, and store ink and/orother pen actions or events. The ink platform also may include a mark-uplanguage including a language like the extensible markup language (XML).Additional examples of the ink platform may use the DCOM (distributedcomponent object model) implementation. Yet further implementations maybe used including the Win32 programming model and the .Net programmingmodel from Microsoft Corporation. These platforms are commerciallyavailable and known in the art.

In addition to use with full performance pen-based computing systems or“tablet PCs” (e.g., convertible laptops or “slate” type tablet PCs),aspects of this invention can be used in conjunction with other types ofpen-based computing systems and/or other devices that accept data aselectronic ink and/or that accept, process, or display electronic pen orstylus input, such as: hand-held or palm-top computing systems; personaldigital assistants; pocket personal computers; mobile and cellulartelephones, pagers, and other communication devices; watches;appliances; and any other devices or systems that include a monitor orother display device and/or a digitizer that presents printed orgraphical information to users and/or allows input using an electronicpen or stylus or that can process electronic ink collected by anotherdevice (e.g., a conventional desktop computer that can processelectronic ink collected by a tablet PC).

The invention now will be described in conjunction with the remainingfigures, which illustrate various examples of the invention andinformation to help explain the invention. The specific figures andinformation contained in this detailed description should not beconstrued as limiting the invention.

As described above, aspects of the present invention relate generally touser interfaces, systems, and methods for interacting with andprocessing electronic ink using pen-based computing systems and othercomputing systems using a pen as an input device. In conventionalcomputer systems that include a mouse (or some other pointing device)and/or a keyboard, editing machine-generated text is relatively easy andquick, and such systems and methods are very familiar to users. With thegrowing popularity of pen-based computing systems, however, theseconventional hardware based editing tools are not always available to orpreferred by users, particularly for users that input much or all dataand/or fully control the computer's user interface and operating systemusing only a pen. While in some instances a user can call up and use asoft keyboard and the pen to edit and/or enter machine-generated text,doing so can be slow, cumbersome, and frustrating, particularly when alarge amount of text must be entered, reviewed and/or edited.

In some exemplary pen-based computer systems, an electronic pen may beused that has an eraser end opposite the writing end of the pen. Asdiscussed above, the eraser end may contact the digitizer and moveacross the display to indicate portions of the electronic ink on thedisplay to be erased. In general, in accordance with aspects of theinvention, there are at least two types of erasing systems that may beused with pen-based computing systems. The first is a “pixel” erasersystem in which the eraser end of the pen is put in contact with thedisplayed electronic ink and the pixels of electronic ink covered by orcontacted by the area of the eraser will be deleted (e.g., changed, incolor, to correspond to the background color of the document in thatarea). The second type of erasing system is a “stroke” eraser system. Inusing a stroke eraser, all of the pixels of any electronic ink strokecontacted with the area of the eraser end will be deleted (e.g.,changed, in color, to correspond to the background color of the documentin that area).

The electronic ink eraser according to at least some examples of thepresent invention may constitute the non-writing end of the electronicpen included with the pen based computing system. As the pen is beingused, a user wishing to erase or delete some or all of the electronicink displayed may reverse the pen in his or her hand and use thenon-writing end as an eraser, similar to the action a user would takewhen using a conventional pencil. Of course, if desired, a separateeraser device may be provided independent of the electronic pen, withoutdeparting from the invention. As still another example, if desired, thesame end of the pen may be used as an eraser as is used for enteringink, e.g., after selecting an erase mode from a menu or toolbar, byactivating an “erase” switch or button on the stylus or computer, etc.

To erase the electronic ink, the user may contact the eraser end of thepen to the display surface of the notebook computer. As the user appliesa force having a component that is substantially perpendicular to thedisplay surface and moves the eraser, the electronic ink beneath theeraser end of the pen during its movement, will be deleted. The user maymove the eraser end of the pen across any desired ink to be deleted,thereby erasing the pixels that are contacted by the eraser end. Inerasing the pixels, the color of each pixel may be changed to abackground color at that portion of the document thereby giving theappearance of the ink having been erased. Once the user has reached theend of the ink to be deleted, the force applied to the display surfaceis removed and no additional ink will be erased.

A predetermined amount of pressure applied to the display by the pen mayerase one area of ink that is a predetermined width. The eraser systemsand methods according to the present invention allow the user to erasewider swaths of ink by increasing the pressure applied to the displaysurface (and vice versa). Generally, in accordance with at least someexamples of the invention, the width of ink to be erased will increaseproportionally with the amount of pressure applied to the digitizersurface by the eraser. For instance, as more pressure is applied to thedisplay, the size of the area to be erased increases (e.g., the eraserpath width will be widened). This allows a user to erase greater amountsof ink in a single stroke of the eraser, if desired. In one example, thewidth of the ink to be erased may increase linearly with increasedpressure. In another example, the width of the ink to be erased mayincrease exponentially or logarithmically as pressure increases.

As applied to a pixel type erasing system, the increased pressure willincrease the size of the area of the eraser (or the eraser's pathwidth). Pixels of ink located beneath the widened area of the eraserwill be erased. Additional ink beyond the widened eraser area may not bedeleted. FIGS. 3A-3C depict aspects of the present invention in the formof a pixel type eraser.

FIG. 3A depicts a user interface 300 with a block of electronic ink 302.The pen 204 is positioned at a point where the erasure may begin. As thepen 204 moves across the interface 300, over the electronic ink, thepixels under the area of the eraser are changed to a background color,giving the appearance of the ink having been erased, as seen in FIG. 3B.

With further reference to FIG. 3B, a relatively light pressure wasapplied to the display surface via the pen 204 in this example. Thislight pressure erased a relatively narrow portion of the electronic ink304 (e.g., produced a narrow erased path). FIG. 3C depicts an example inwhich the electronic ink was erased under an additional or heavierpressure than that shown in FIG. 3B. As more pressure is applied, awider portion or path of electronic ink 306 may be erased.

When utilized as a stroke type eraser, the increased pressure exerted bythe eraser will again increase the area to be deleted. Any ink strokewithin the widened area of deletion will be erased, that is, the pixelsof the entire stroke having one or more pixels contacted by the eraser,may be changed to a background color to give the appearance of the inkcorresponding to that stroke having been erased. In other words, astroke may begin or have some portion within the area of deletion (e.g.,the contact end of the eraser) but end or have some portions outside ofit. With a stroke type eraser, the entire stroke would be deleted,including the portion found outside the area of contact with the eraser,provided the eraser contacts at least one pixel contained in the stroke.

FIG. 4A depicts a sample of electronic ink 400 as it may appear on auser interface 402 and used in conjunction with a stroke eraser. Aslight pressure is applied via the electronic pen 204, the pixels of theentire stroke within the area contacted by the eraser will be erased. Asseen in FIGS. 4B and 4C, light pressure is applied by the eraser toremove the entire stroke of the letter “S” and the vertical portion ofthe letter “t.” Although the eraser area did not cover the entirestroke, the pixels of the entire stroke were changed to a backgroundcolor. Notably, in this example, the eraser path was close to, but didnot contact, the horizontal stroke of the letter “t” and the verticalstroke of the letter “r.”

In FIGS. 4D and 4E, higher pressure is applied to remove a wider portionof electronic ink 400 (e.g., to provide a larger eraser width and/oreraser contact path). In this example, essentially the same eraserstroke is performed as in FIG. 4B, however, additional pressureincreases the eraser width and erases additional ink. As is seen in FIG.4E, the same stroke as in FIG. 4B deleted the pixels of the entirestroke of the letter “S,” the entire stroke of both portions of theletter “t” and the vertical portion of the letter “r.”

Methods used for measuring the force applied to the display surface bythe eraser may be any of those generally known in the art (e.g., as usedfor measuring pressure in applying electronic ink to a digitizer). Forinstance, the electronic pen may include a plunger element that may helptransmit the erasing pressure into the pen structure and to a pressuresensor. In another example, the pen may have a contact member thatperforms a similar function to that of the plunger element. In yetanother example, pressure may be sensed by the digitizer. Such pressuremeasuring systems generally are known in the art.

In order to gauge the width of the eraser swath that should be used,e.g., the amount of pressure that corresponds to each erasing path widthto be erased, the user may have to perform an initial setup procedure,at least in some examples of the invention. For instance, prior toinitial use of the pressure eraser system, a user may be requested toprovide input corresponding to the amount of pressure that willcorrespond to the different widths to be erased. Such procedures mayinclude, for example, the user applying a certain amount of pressure tothe display and assigning an eraser width to that amount of pressure.The user may repeat this procedure until all available eraser widths areassociated with a certain amount of pressure applied by the user. Inanother example, the user may be asked to press as hard as possible onthe display surface. This will provide the maximum pressure value tocorrespond to the maximum eraser width. The various sizes of the erasermay then be interpolated based on a scale from zero to the maximumpressure value.

These initial setup procedures will allow the pressure eraser system tobe customized to the various amounts of pressure that a particular usermay apply. In other examples, systems and methods according to theinvention may automatically assign various eraser widths to certainincident pressures, e.g., based on initially sensed pressures associatedwith a user's input.

The eraser system of the present invention may also include a maximumpressure limit. Once the user applies the maximum amount of pressure,any additional pressure will not result in a wider eraser swath.Instead, the swath will remain the width associated with the maximumpressure limit. A minimum eraser width also may be assigned as a lowpressure threshold without departing from the invention.

A calibration procedure may also be performed for the size variantpressure erase system. This procedure may be necessary, for example, dueto differences in hardware, such as different manufacturers of tabletPCs, pressure sensors and electronic pens. Such calibration may includedetermining the minimum amount of pressure necessary to erase a givenamount of text for that particular computer system. In addition, themaximum pressure for that particular computer system may also need to bedetermined. Such calibration procedures may be performed by themanufacturer prior to sale of the system or by the user as needed (e.g.,as part of an initial set up routine).

Although the subject matter has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the subject matter defined in the appended claims is notnecessarily limited to the specific features or acts described above.Rather, the specific features and acts described above are disclosed asexample forms of implementing the claims. Numerous other embodiments,modifications and variations within the scope and spirit of the appendedclaims will occur to persons of ordinary skill in the art from a reviewof this disclosure.

1. A method of removing electronic ink from a display, comprising:receiving user input indicating an ink erasure action, wherein the userinput includes contacting a stylus with a digitizer; determining acontact pressure between the stylus and the digitizer; and setting aneraser width based, at least in part, on the contact pressure.
 2. Themethod of claim 1, further comprising: changing a pixel color of anypixel at a location corresponding to an eraser path along the digitizerto a background color.
 3. The method of claim 1, further comprising:changing a pixel color of all pixels within a stroke at a locationcorresponding to an eraser path along the digitizer to a backgroundcolor.
 4. The method of claim 1, further comprising: changing the eraserwidth in response to a change in the contact pressure between the stylusand the digitizer.
 5. The method of claim 4, wherein the change ineraser width due to the change in contact pressure is proportional tothe increase in pressure.
 6. The method of claim 5, further comprising amaximum pressure at which additional pressure will maintain a maximumeraser width.
 7. The method of claim 6, wherein the eraser width remainsconstant at a constant pressure.
 8. A method of removing electronic inkfrom a display, comprising: receiving a first user input, wherein thefirst user input comprises first pressure information; identifying afirst removal area, wherein a size of the first removal area is definedby the first pressure information; receiving a second user input,wherein the second user input comprises a second pressure information;and modifying the size of the first removal area based on the secondpressure information.
 9. The method of claim 8, wherein the secondpressure input is greater than the first pressure input.
 10. The methodof claim 8, further comprising a first eraser position and a seconderaser position.
 11. The method of claim 10, further comprising:changing a pixel color of any pixel at a location along an eraser pathbetween the first eraser position and the second eraser position to abackground color.
 12. The method of claim 10, further comprisingchanging a pixel color of all pixels within a stroke at a location alongan eraser path between the first eraser position and the second eraserposition to a background color.
 13. The method of claim 8, wherein thesize of the first removal area changes proportionally with changingpressure input.
 14. The method of claim 8, wherein the user input isreceived via an electronic pen.
 15. The method of claim 8, wherein theelectronic pen comprises a pressure sensor.
 16. The method of claim 8,wherein the user input is received via a touchpad.
 17. The method ofclaim 8, wherein the second pressure information comprises a maximumforce.
 18. A system of erasing electronic ink, comprising: a userinterface including a display screen and a digitizer; an electronic penincluding a housing, a writing end and a non-writing end; a pressuresensing system, configured to determine the amount of pressure appliedto the electronic pen; and a processor for determining a size of anelectronic ink removal area based on a first pressure and a secondpressure received via the user input device.
 19. The system of claim 18,wherein the pressure sensing system is configured within the electronicpen.
 20. The system of claim 18, further comprising a maximum pressure,wherein any additional pressure applied in excess of the maximumpressure maintains the size of the electronic ink removal area.